Objective Bayesian Variable Selection in 1 Well - Formulated Models 2 Short Title : Variable Selection in Well - Formulated Models
نویسندگان
چکیده
6 This paper investigates objective Bayesian variable selection when there is a hier7 archical dependence structure on the inclusion of predictors in the model, that, when 8 ignored, makes the variable selection dependent on how the predictors are coded. In 9 particular, we study the type of dependence found in polynomial response surfaces 10 of orders two and higher. We develop three classes of priors on the model space, 11 investigate both their operating characteristics and their effect on the variable selec12 tion outcome, and provide a Metropolis-Hastings algorithm for searching the space of 13 models. The tools proposed allow fast and thorough exploration of model spaces that 14 account for hierarchical polynomial structure in the predictors. Proposed choices for 15 the model priors allow for strong control over the number of false positives included in 16 “good” models. 17
منابع مشابه
Model Selection for Mixture Models Using Perfect Sample
We have considered a perfect sample method for model selection of finite mixture models with either known (fixed) or unknown number of components which can be applied in the most general setting with assumptions on the relation between the rival models and the true distribution. It is, both, one or neither to be well-specified or mis-specified, they may be nested or non-nested. We consider mixt...
متن کاملA Comparison between New Estimation and variable Selectiion method in Regression models by Using Simulation
In this paper some new methods whitch very recently have been introduced for parameter estimation and variable selection in regression models are reviewd. Furthermore , we simulate several models in order to evaluate the performance of these methods under diffrent situation. At last we compare the performance of these methods with that of the regular traditional variable selection methods such ...
متن کاملAn Overview of the New Feature Selection Methods in Finite Mixture of Regression Models
Variable (feature) selection has attracted much attention in contemporary statistical learning and recent scientific research. This is mainly due to the rapid advancement in modern technology that allows scientists to collect data of unprecedented size and complexity. One type of statistical problem in such applications is concerned with modeling an output variable as a function of a sma...
متن کاملBayesian Nonparametric Models
A Bayesian nonparametric model is a Bayesian model on an infinite-dimensional parameter space. The parameter space is typically chosen as the set of all possible solutions for a given learning problem. For example, in a regression problem the parameter space can be the set of continuous functions, and in a density estimation problem the space can consist of all densities. A Bayesian nonparametr...
متن کاملMean Field Approximation in Bayesian Variable Selection
Variable selection for a multiple regression model (Noisy Linear Perceptron) is studied with a mean field approximation. In our Bayesian framework, variable selection is formulated as estimation of discrete parameters that indicate a subset of the explanatory variables. Then, a mean field approximation is introduced for the calculation of the posterior averages over the discrete parameters. An ...
متن کامل